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February 11,2004 

Our File 7146.0048 

Mail Stop Petitions 
Commissioner of Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 

Re: Renewed Petition Under 37 CFR 1.137(b) 

United States Patent Application Serial No. 09/455,964 

For: A METHOD OF CREATING A SEMANTIC VIDEO SUMMARY USING 

INFORMATION FROM SECONDARY SOURCES 
Filed: December 6, 1999 

Dear Sir: 

Enclosed for filing is a Renewed Petition for Revival of an Application for Patent 
Abandoned Unintentionally under 37 U.S.C. 1.137 (b) along with a copy of the decision on 
Petition dated February 4, 2 0 04. Additionally, we enclose historical documents including an 
Amendment in Response dated November 21, 2003 which included a Petition for Extension of 
Time to Respond to the Outstanding Office Action along with an acknowledgment postcard 
stamped and dated by the USPTO. Also we note that the Petition Fee has been accepted 
previously and no fee is due at this time. We include an acknowledgment postcard herewith. 

Please charge Deposit Account No. 03-1550 for any additional fees which may be 
required or credit any over payments to that account. A duplicate copy of this transmittal letter is 
enclosed. 

Respectfully submitted, 




Kevin L. Russell 

KLR:djs 
Enclosures 




CTITION FOR REVIVAL OF AN APPLICATION FOR PATENT 
fDONED UNINTENTIONALLY UNDER 37 U.S.C. 1.137(B) 



Docket No. 

KLR 7146.0048 



pplicant: Qian, et al. Group Art Unit: 261 1 

Serial No.: 09/455,964 Examiner: Son P. Huynh 

Filed: December 6, 1999 

Title: A METHOD OF CREATING A SEMANTIC VIDEO SUMMARY USING INFORMATION 
FROM SECONDARY SOURCES 

RECEIVED 

February 11,2004 

Mail Stop Petitions FEB 2 0 2004 

Commissioner of Patents npr'P? /r- nrnrw 

P.O. Box 1450 PETITION 

Alexandria, VA 22313-1450 



The above-identified application became abandoned for failure to timely file a 
response an outstanding Office Action within the statutory period of three months from the 
mailing date of the Office Action dated April 28, 2003. The abandonment date of this applica- 
tion is October 29, 2003 (i.e. the day after the expiration date set for reply). 



APPLICANT HEREBY PETITIONS 
FOR REVIVAL OF THIS APPLICATION 



1. Petition fee 

□ Small entity fee of $ (37 C.F.R. 1017(m)) 

□ Small entity statement enclosed herewith. 

□ Small entity statement previously filed. 

g] Other than small entity fee $ 1,300 : (37 C.F.R. 1.1 7(m)) 

2. Reply and/or fee 

A. The reply and/or fee to the above-noted Office Action in the form of an Amendment: 

13 has been filed previously on November 2 1 , 2003 , and/or 

El is enclosed herewith. 

B. The issue fee of $ : : 

□ has been paid previously on. 
n is enclosed herewith. 



PETITION TO REVIVE 



in^^vi 



3. Terminal disdaimSrwith a disclaimer fee 

^ Since this utility/plant application was filed on or after June 8 5 1 995 no terminal 

disclaimer is required. 
□ A terminal disclaimer (and disclaimer fee (37 C.F.R. 1 .20(d)) of $ for a 

small entity or $ for other than a small entity) equivalent to the number of 

months from abandonment to the filing of this petition is enclosed herewith. 

4. Statement: 

The entire delay in filing the required reply from the due date for the reply until the 
filing of a grantable petition under 37 C.F.R. 1.137(b) was unintentional due to docketing 
error. 



Dated: February 11, 2004 




Kevin L. Russell 
Reg. No. 38,292 

Chernoff Vilhauer McClung & Stenzel 

1600 ODS Tower 

601 SW Second Avenue 

Portland, Oregon 97204 

Tel. No. (503)227-5631 



Enclosures: 

13 Reply: 



"Renewed Petition under 37 CFR 1 .137(B) (fee paid previously) 
Petition to Revive application unintentionally abandoned 
A copy of the Amendment filed in Response to the April 28, 2003 Office Action; 

A copy of the USPTO's February 4, 2 0 04 Office Action "ON PETITION"; and 

13 Acknowledgment Postcard 
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CERTIFICATE OF UNDER 37 CFR §§ 1.8(a) and 1.10 

I hereby certify that, on the date below, this correspondence is being: 
a deposited with the United States Postal Service in an envelope addressed to: 
Mail Stop Petitions, Commissioner of Patents, P.O. Box 1450, Alexandria, VA 22313-1450 
on February 11, 2004 with sufficient postage as first class mail. 



Date: February 11,2004 




PETITION TO REVIVE 
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1^^-— COMMISSIONER FOR MATE NTS" 

nr a I irJV r" ! J United States Patent and Trademark Office 

«iV-JV^ P.O. Box I 490 

Alexandria, VA 223 1 3- 1 4SO 
www.uspto.gov 



FEB 2 0 2004 
OFFICE OF FETJTTOS 



Paper No. 12 



CHARNOFF VILHAUER MCCLUNG & STENZEL, LLP 
1600 ODS TOWER 

601 S W SECOND AVENUE MAII FD 

PORTLAND, OR 97204 COPY MAILtU 

FEB 0 4 2004 
OFFICE OF PETITIONS 

In re Application of 

Application No. 09/455,964 ON PETITION 

Filed: December 6, 1999 
Attorney Docket No. KLR:7146.048 

This is a decision on the petition under 37 CFR 1 . 137(b), filed November 24, 2003, to revive the 
above-identified application. 



The petition is DISMISSED. 

Any request for reconsideration must be submitted within TWO (2) MONTHS from the mail date 
of this decision. No further petition fee is required for the request. Extensions of time under 37 
CFR 1 136(a) are permitted. The reconsideration request should include a cover letter entitled 
"Renewed Petition under 37 CFR 1 137(b)." This is not a final agency action within the meaning 
of5U.S.C. §704. 

This application became abandoned for failure to timely reply to the non-final Office action mailed 
April 28 2003. No extensions of time under the provisions of 37 CFR 1.136(a) were timely 
obtained. Accordingly, this application became abandoned on July 29, 2003. 

A grantable petition under 37 CFR 1 .137(b) must be accompanied by: 
m the required reply, 1 

\l\ a^tSent thSt the entire delay in filing the required reply from the due date for the reply 
( } untU thVfil ng of a grantable petition pursuant to 37 CFR 1.137(b) was unintentional, and 
(4) ^terminal disclaimer and fee If the application was filed on or before June 8, 1995 or if the 
application is a design application. 

Where there is a question as to whether either the abandonment or the delay in filing a petition 
under 37 CFR 1. 137 was unintentional, the Commissioner may require additional lnlormation.- 



1 In a nonprovisional application abandoned for failure to prosecute, the required reply may be met by the filing of a 
continuing application. In an application or patent, abandoned or lapsed for failure to pay the issue fee or any portion thereof, the 
required reply must be the payment of the issue fee or any outstanding balance thereof. 



2 See MPEP 71 1 .03(c)(mXC) and (D). 
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The instant petition lacks item (3). After a review of the file, it appears that petitioner did not 
include an actual petition under 37 CFR 1.137(b), but rather only indicated payment for one on 
the fee transmittal sheet. In this regard, the required unintentional delay statement was not 
included. Enclosed is a petition under 37 CFR 1 .137(b) form, which also can be found on the 
USPTO website, for petitioner's convenience. 

An extension of time under 37 CFR 1.136 must be filed prior to the expiration of the maximum 
extendable period for reply. See In re Application of S. . 8 USPQ2d 1630, 1631 (Comm'r Pats. 
1988). Accordingly, since the $950.00 extension of time fee submitted with the petition on 
November 24, 2003 was subsequent to the maximum extendable period for reply, this fee is 
unnecessary and will be credited to petitioner's deposit account as authorized. 

Further correspondence with respect to this matter should be addressed as follows: 

By mail: Mail Stop PETITION 

Commissioner for Patents 
Post Office Box 1450 
Alexandria, VA 22313-1450 

Effective December 1, 2003, the Office of Petitions can no longer receive hand-carried 
correspondence, or facsimile transmissions of correspondence. The centralized location for 
hand-carried correspondence is the existing Customer Window located at: 

2011 South Clark Place 
Crystal Plaza 1 Lobby 
Room 1B03 
Arlington, VA 22202 

The centralized facsimile number is (703) 872-9306* 

Telephone inquiries should be directed to Paralegal Liana Chase at (703) 306-0482. 

Karen Creasy s 
Petitions Examiner 
Office of Petitions 
Office of the Deputy Commissioner 
for Patent Examination Policy 
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Applicant 



Richard Qian 



Filed 



December 6, 1999 



Title 



METHOD OF CREATING SEMANTIC VIDEO USING INFORMATION 
FROM OTHER SOURCES 



TC/A.U. 
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Examiner 



Huynh, Son P. 



Docket No. 



7146.0048 



Commissioner for Patents 
P.O. Box 1450 
Alexandria VA 22313-1450 



AMENDMENT 



Dear Sir: 



In response to the Office action of April 28, 2003, please amend the above- 
identified application as follows: 

Amendments to the Specification are not included with this paper. 

Amendments to the Claims are reflected in the listing of claims which begins on page 2 of this 
paper. 

Amendments to the Drawings are not included with this paper. 
Remarks/Arguments begin on page 5 of this paper. 



This listing of claims will replace all prior versions, and listings, of claims in the application: 
Listing of Claims: 

1 (amended). _ A method of creating a semantic summary of a video comprising 
the steps of: 

(a) identifying a domain of said video; 

(b) using said domain to locate information related to said video at a 
source other than said video; 

(c) extracting a datum related to a semantic event from said 
information; and 

(d) identifying a portion of said video e xtract i ng cont e nt r e lat e d to sa i d 
s e mant i c e v e nt from sa i d vid e o related to said datum. 

2 (original). The method of claim 1 wherein said information is a textual 
summary of events. 

3 (original). The method of claim 1 wherein said information is included in a 
worldwide web site. 

4 (original). The method of claim 1 wherein said information is included in an 
electronic programming guide. 

5 (original). The method of claim 1 wherein said domain is identified from an 
electronic programming guide. 

6 (original). The method of claim 1 further comprising the step of selection of 
said datum by a user of said summary. 

7 (amended). A method of abstracting video comprising the steps of: 
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(a) locating an index of said video from a source external to said video; 
b) identifying a domain of said video for creating a video abstraction; 

(c) using said domain together with to i d e ntify i n said index to identify 
portions of said video for inclusion in said video abstraction; and 

(d) extracting said identified portions of said video from said video to 
form said video abstraction . 

8 (original). The method of claim 7 wherein said index is included in a worldwide 
web site. 

9 (original). The method of claim 7 wherein said index is included in an 
electronic programming guide. 

10 (original). The method of claim 7 further comprising the step of identification 
of said domain by a user of said abstraction. 

1 1 (amended). A method of creating a semantic summary of a video comprising 
the steps of: 

(a) identifying a domain of said video; 

(b) using said domain to locate a textual summary of said video; 

(c) extracting a datum related to a semantic event relevant to said 
video summary from said textual summary; 

(d) locating content in said video corresponding to said datum; and 

(e) extracting said content related to said semantic event from said 
video corresponding to said datum from said v i d e o for inclusion in 
said a semantic summary including at least one portion of said 
video . 

12 (amended). A method of abstracting video comprising the steps of: 
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(a) locating an index of said video in at least one of a worldwide web 
site and a programming guide; 

(b) identification of a domain of said video for creating a video 
abstraction by a user of sa i d abstract i on ; 

(c) using said domain together with to s ele ct i n said index video to 
identify portions of said video for inclusion in said video abstraction; 
and 

(d) extracting said identified portions of said video from said video to 
form said video extraction. 
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REMARKS 

The Examiner rejected claims 1-4 and 6 under 35 U.S.C. Section 102(b) 
as being anticipated by Dodson et al., EP 0,848,554. 

Dodson et al. teach a system for accessing television program 
information, such as context sensitive information using the Internet. See Dodson et 
al., abstract. For the domain of a "movie", the user may do a textual search for context 
sensitive information, such as the program title, actors, start time, end time, and 
director. See, Dodson et al., Figs. 2 and 3. The result of the textual search is an 
overlay 400 that includes a list of textual hits associated with the movie. See, Dodson 
et al. Fig. 4. As it may be observed, the textual hits include identification to further 
textual information that the user may desire to access, such as textual movie reviews, 
textual interviews with the actors, and a textual account of the directors' interpretation. 
When one of the textual hits is selected an overlay appears of that further textual 
information. See, Dodson et al. Fig. 5. Accordingly, Dodson et al. is directed to a 
textual search mechanism to locate additional textual information associated with the 
movie for display to the user. 

Claim 1 patentably distinguishes over Dodson et al. by claiming a method 
of creating a semantic summary of a video that includes identifying a domain of the 
video; using the domain to locate information related to the video at a source other than 
the video; extracting a datum related to a semantic event from the information; and 
identifying a portion of the video related to the datum . 

In contrast, Dodson et al. does not identify a portion of the video related to 
the datum, but rather the additional textual information is simply associated with the 
video as a whole. 

Claims 2-6 depend from claim 1 and are patentable for the same reasons 
asserted for claim 1 . 

The Examiner rejected claims 7-10 and 12 under 35 U.S.C. Section 
102(e) as being anticipated by Boyer et al., U.S. Patent No. 6,268,849. 

Boyer et al. disclose an interactive television program guide for use by a 
user. A server provides the textual content together with multimedia clips of information 




related to the shows identified within the program guide to the user as needed. See, 
column 2, lines 24-65. As illustrated in FIG. 8, the user may select among many 
different presentation formats. For example, the user may select a sporting event in 
progress and also receive real-time embedded data and any associated supplemental 
information. See, column 8, lines 57-62. This associated data is simply associated 
with the video as a whole. As illustrated in FIGS. 9 and 10, the user may navigate 
through the television program guide and ultimately view multimedia clips and 
supplemental information, such as statistics (see FIG. 10). 

Claim 7 patentably distinguishes over Boyer et al. by claiming a method of 
abstracting video including locating an index of the video from a source external to the 
video and identifying a domain of the video for creating a video abstraction. Then using 
the domain together with index to identify portions of the video for inclusion in the video 
abstraction. Then extracting the identified portions of the video from the video to form 
the video abstraction . 

Claim 12 patentably distinguishes over Boyer et al. for similar reasons. 

Boyer et al. simply fail to suggest using the index together with identifying 
a domain to create the video abstraction from the video itself. Rather, Boyer et al. 
simply disclose a system by which video (multimedia) and textual information related to 
a video are accessible to the user. 

Claims 8-10 depend from claim 7 and are patentable for the same 
reasons asserted for claim 7. 

The Examiner rejected claim 11 as being anticipated by Schein et al., U.S. 
Patent No. 6,002,394. 

Schein et al. in FIGS. 16A-20C disclose a electronic programming guide 
that includes the ability for navigation. 

Claim 1 1 patentably distinguishes over Schein et al. by claiming extracting 
content related to the semantic event from the video corresponding to the datum for 
inclusion in a semantic summary including at least one portion of said video. 

Schein et al. fail to suggest the extraction of video content from the video 
for a semantic summary based upon the datum. 
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The applicant respectfully requests that a timely Notice of Allowance be issued in 
this case. If the Examiner believes that for any reason direct contact with applicant's attorney 
would advance the prosecution of this application, the Examiner is invited to telephone the 
undersigned at the number below. 



Respectfully submitted, 

Chernoff Vilhauer McClung & Stenzel, LLP 

1600 ODS Tower 

601 SW Second Avenue 

Portland, Oregon 97204 




Kevin L. Russell 
Reg. No. 38,292 
Telephone No. (503) 227-5631 
FAX No. (503) 228-4373 
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